Towards Handling Uncertainty-at-Source in AI – A Review and Next Steps for Interval Regression

Kabir, Shaily; Wagner, Christian; Ellerby, Zack

Abstract

Most of statistics and AI draw insights through modelling discord or variance between sources (i.e., inter-source) of information. Increasingly however, research is focusing on uncertainty arising at the level of individual measurements (i.e., within- or intra-source), such as for a given sensor output or human response. Here, adopting intervals rather than numbers as the fundamental data-type provides an efficient, powerful, yet challenging way forward—offering systematic capture of uncertainty-at-source, increasing informational capacity, and ultimately potential for additional insight. Following progress in the capture of interval-valued data in particular from human participants, conducting machine learning directly upon intervals is a crucial next step. This paper focuses on linear regression for interval-valued data as a recent growth area, providing an essential foundation for broader use of intervals in AI. We conduct an in-depth analysis of state-of-the-art methods, elucidating their behaviour, advantages, and pitfalls when applied to synthetic and real-world data sets with different properties. Specific emphasis is given to the challenge of preserving mathematical coherence, i.e., models maintain fundamental mathematical properties of intervals. In support of real-world applicability of the regression methods, we introduce and demonstrate a novel visualization approach, the interval regression graph, or IRG , which effectively communicates the impact of both position and range of variables within the regression models—offering a leap in their interpretability. Finally, the paper provides practical recommendations concerning regression-method choice for interval data and highlights remaining challenges and important next steps for developing AI with the capacity to handle uncertainty-at-source.

Citation

Kabir, S., Wagner, C., & Ellerby, Z. (2023). Towards Handling Uncertainty-at-Source in AI – A Review and Next Steps for Interval Regression. IEEE Transactions on Artificial Intelligence, 5(1), 3-22. https://doi.org/10.1109/TAI.2023.3234930

• Journal Article Type: Article
• Acceptance Date: Jan 2, 2023
• Online Publication Date: Jan 9, 2023
• Publication Date: Jan 9, 2023
• Deposit Date: Mar 1, 2023
• Publicly Available Date: Mar 1, 2023
• Journal: IEEE Transactions on Artificial Intelligence
• Electronic ISSN: 2691-4581
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 5
• Issue: 1
• Pages: 3-22
• DOI: https://doi.org/10.1109/TAI.2023.3234930
• Keywords: Computer Science Applications; Artificial Intelligence
• Public URL: https://nottingham-repository.worktribe.com/output/15940012
• Publisher URL: https://ieeexplore.ieee.org/document/10012447
• Additional Information: © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.